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ABSTRACT 

A study directed toward the education of preschool 
children is presented. This study, the Appalachia Preschool Education 
Program, was designed to affect the performance of children aged 3, 

4, and 5 in four skill areas* orienting and attending, motor 
activity, language, and cognition. One of the instruments used in the 
evaluation of the program was the Peabody Picture Vocabulary Test 
(PPVT). Results of the administration of that test to children in the 
Preschool Education Program are presented. The report is divided into 
three sections. The first describes the test and its administration; 
the second presents the analysis of test data and compares the 
performance of children in three treatment groups and one control 
group. The third section explains and defends the use of post-test 
PPVT scores as a co variate in analyzing results of testing used in 
other. instruments, (Author/CK) 
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Analysis of Intelligence Scores 

■■ ! m 

Introduction • . 

The Appalachia Pres chooly Education Program was designed* to affect the 
performance of children aged 3, 4, and 5 in four skill areas : orienting 
and attending, motor activity, language, and cognition (Hooper and Marshall, 
1968). One of the instruments used in the evaluation of the program was 
the Peabody Picture Vocabulary Test (PPVT), Results of administration of 
that test to children in the Pres chool\ Education* Program are presented in 
this report. The report is divided into three sections. The 1 first describes 
the test and its administration, the second presents the analysis of test 
data and compares the performance. of children in three treatment groups and 
one control group. The third section explains and defends the use of post • 

, test, PPVT scores as a covariate in analyzing results of testing using other 
instruments, , ' ’ . 

i 

^ . 

Description and Administration of the PPVT 

The Peabody Picture Vocabulary Test consists of a series of 150 plates, . 
each containing four illustrations. One of the four illustrations on dach 
plate corresponds to a key. word chosen from Webster’s New Collegiate Dictio- 
nary (G. and C. Merriam Co,, 1953), * 

■ , In ^admin istering the test, the examiner begins at a lege T recommended 
in the manual fon the age level of the youngster being tested. If the 
subject misses anUtem before correctly answering eight items in a row, the 
test administrator works backwards from the mistake and continues until eight 
consecutive correct responses are achieved by the child. The examiner pro- 
nounces a word from the list, while at the same ’time showing the child a 
plate containing /the illustration of the word,* The child responds by pointing 
to the^ picture' corresponding to the word named. Following six incorrect 



answers in eight responses, testing is discontinued. The total number of 
correct responses- on all items is the raw score, and from that a mental age 
(M.A.) score is derived. In addition, raw score and chronological age are/ 
used to compute a deviation IQ score with a mean of 100 and a standard devia- 
t ion of 15. 



Age Comp ar i sons . ? ' 

Children who were selected for the three treatment groups in the Pre- 
school Education Program were assigned to an age classification on the basis 
of chronological age. as of October 1, This procedure made i z possible for 
children in one age group to differ by as much as one year, and even greater 
differences in average ’age in months among the groups were therefore possible. 
In order to take age differences into account in the analysis, it was necessary 
to compare children in the treatment groups on this factor. 

Table 13,1 summarizes the data. The figures shown are mean age ip months 
by sex and a^ge classification for. the three treatment aii b d»_o.nfc control groups. 
The figure given is the mean age in months at the end of the third year of 
testing, so that children who had attained their third birthday prior to 
October 1 of the previous year had by this time passed their fourth birthdays. 
The control group, for example, averaged exactly 4 years of age, while the 
three treatment groups were all somewhat older. 

Analysis of variance of these data {Table 13.2 ) showed that the groups 
differed significantly from one another in mean age in months. I Subsequent 
analysis using Dunnett's procedure revealed that the TV only group was signifi- 
cantly older than the other three. The means for the. four groups are illus- 
trated in Figure 13,1, 
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Analysis of Results 

In June, 1970 — at the end of the- second year of the field test of the 
Preschool Education Program- -the PpyT.was admin is t e re d to a random ly selected/ 
sample of 168. 4- and 5-year-old children in three treatment and one control 
groups. The treatment groups were: 

( 

• Those receiving three components of the program— television, home 
visitors, and mobile classroom (TV-HV-MC) . 

T! 

• Those receiving only the first two components (TV-HV) . yC 

... . f- 

• Those receiving television only (TV only)-. — — - V 

The control group consisted of children of similar backgrounds from 
another region in the. stat-e'. The PPVT was administered in September, 19 70, 
to 74 3-year-old children who were entering the program for the first time. 
These test results'/ on a total of 242 children, are reported in Table 13,3 
as pretest scores. Tests administered in June, 1971, to 396 children--all 
who were. .then in the pro gram- -are shown in that table as post-test results. 

The ana lyses which follow are based on the data contained in. Table 13.3..-'-' 

Analysis of variance on the post-test PPVT scores showed significant - 
treatment effects (Table 13,4), The differences were attributable to the 
higher mean for the TV-HV-MC group as shown by post hoc. comparisons using 
Dennett’ s test. Group means on the PPVT posjt-tist are illustrated in Figure 
13,2. Similar results were observed end of the second year of the 

field test of the program, so that,,. to some extent the present findings are 
the result of carryover effects "from the first two years , of the program! 

They also may be attributable to preexisting differences in the skills which- - 
are measured by theJBPVT. To control fbr .bbth f ac tors - - cumul^t lv.e--effg'c ts'^ and 
preexisting differences --it is necessary to examine a group of .children for 
whom pretreatment test data are available and who have been In the program 
for only one year. The 3-year-old group 'fits that description, and what 
follows is an analysis of the performance on pretest and post-test PPVT by 
that group of children. 

Table 13.5 shows the relative position^ of each of eight 3-year-old 
treatment by sex groups on the PPVT pretest. The data are taken directly 
from Table 13 .,3. , ' • 

When comparisons are made on post-test and gain scores, some interesting 
patterns emerge. These data (Table 13.6) show that the control groups 
achieved the smallest gains among the eight groups. Male controls regis- 
tered a gain score of 2.40, and the females increased their score by 3.70 
from pretest to post-test. By , comparlr on, the smallest treatment group gain 
score was 6.87 for male TV only and the largest was 19.30 for males in the 
TV-HV-MC group. In spite of the fact that the two control groups started ' 
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Table 13.4 





Analysis 


of Variance 


Summary Tabl 


e on PPVT Post 


-test Scores 
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Figure 13.2 

PPVT 3-Year-Old Post-test Means by Treat-merit 
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Table .13.5 

PPVT Pretest Means for 3 - Yoar-OJds 
Ordered from High to Low- 





Group 


Mean 


Male 


Control 


36.13 


Female 


TV-HV-MC 


35.18 


Female 


Control 


32.25 


Male 


TV only 


31.63 


Female 


TV only 


28.60 


Female 


TV-HV 


■ 28.40 



Male TV-H.V 

Male TV-HV-MC 



Table 13.6 

PPVT Post-test Means and Gain Scores for 
3-Year-Olds Ordered by Pretest Rank 
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Group 
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Male Control 
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2-. 40 
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Female Control, 


35.95 , 


3.70 




4 


Male TV only 


38.50 


6,87 




5 


> Female TV only 


37.40 ' ' 


8,80 




1 6 


Female TV-HV 


38.29 


9.89 


' 


7 


Male TV-HV 


43.56 


15.56 




8 • 


Male TV-HV-MC 

* 


45.50 


19,30 


* 


o 


' Ife: 






j 



■i 



PPVT IQ Score Means, Standard Deviations, Number 
of Subjects by "Age, Sex., 'and Treatments 
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out high in reTatxoh-^o the treatment groups, by the end of the V^ar they 
had fallen behind. Spearman's rho applied to ranks for the eight groups on 
pretest and post-test results failed to indicate significance (>=-.24) . How 
ever, the trend revealed by/ these comparisons is clear. 



The 'PPVT IQ is a derived score based on a youngster's raw score on the 
test and his- chronological age. Utilizing a table provided by the test 
publisher, the tester selects a point corresponding to the youngster's 
chronological age and raw score. This yields an IQ figure which is devia- 
tion in, nature and allows the student's performance to be compared with that 
of his peers. Both pre and post-test mean IQ scores for each age by sex sub 
group for the three treatment and one control groups are reported, in Table 
13.7. These means axe depicted graphically in Figure 13.3. Since these -IQ 
scores are by normed mean for each age (norm=100) , no representation of the 
normative group is necessary. 



Analysis of variance of the IQ scores computed using PPVT post-test 
results is shown in Table 13.8. Treatment effects were significant. 



150 



100 
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Pre, Po^t 
96.34 104^20 

TV-HV-MC 



Pre Post 
93,98 101.87 

/ TV-HV 



Pre Post 
89,05" 96,51 

TV only 
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Pre Post 
94,08 96.05 

Control 




Figure 13.3 ! ; 
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PPVT Pretest and Post-test IQ 3c, ores by Treatment 
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Table 13.8 



Analysis 


of Variance of 


PPVT Post-test 


IQ 




Source 


ni 


d.f. 


Mean Square 


F_ 


E 


Trt . 


.08 




136409.16 


13.00 


<,05 


Sex 


.003 


1 


18211.56 


1.74 




Age 


.03 


2 


89270.90 


8.51 


<,05 


Trt. by Sex 


.007 


3 


12018.22 


1.15 




Trt. by Age 


.02 


6 


23278.77 


2.22 




Sex by Age 


,004 


2 


9607.99 


0.92 




Trt, by Sex by Age 


.01 


6 


. 13256.92 


1 . 26 




Error 




373 


10489 .04 







Use of PPVT Post-test Scores as Covariates 



, An important consideration in the evaluation of an effort such as the 
Preschool Education Program is the need to control for factors which are 
likely to influence treatment effects. Earlier discussion in this report 
dealt with . the .problem of age differences among treatment groups. Similar 
consideration must be given to uncontrolled variations in ability Although 
the selection procedures involved in choosing children to participate in 
the Preschool Education Program were designed to minimize the possibility 
o± systematic bias favoring one group over others, the possibility remained 
that sampling variations were large enough to distort the results of the 
evaluation. 



Since there was no satisfactory pretest data available on all subjects 
involved in the program, the question was whether to ignore the problem 
altogether or rely on some less satisfactory means of controlling for this 
yfif 10n ' The decision was to use PPVT post-test scores (as shown in Table 
* ) as one covariate in analysis of covariance of scores on the Illinois 
Test of Psych olmguis tic Ability, the Frostig Test of Visual Perception 
and the Appalachia Preschool Test. The other covariate was age in months. 

The disadvantages of using a PPVT post-test score are, of course, 
immediately apparent. Scores were taken at the end of the third year 'of 
the field test and were not immune to treatment effects, as has been shown 
m analyses presented in this report. However, the PPVT was the one instru- 
ment which had been administered throughout the duration of the program 
which yielded an IQ score, and it was therefore the logical measure for use 
in covariance analysis. ' 

The use of the PPVT post-test as a covariate is a conservative pro- 
cedure. If it biases results, it does so in a direction which diminishes 
the likelihood that program treatment effects will appear significant. 
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(ii) 



